Glassy dynamics in thermally-activated list sorting 
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Sorting the integers 1 through N into an ordered list is a simple task that can be done rapidly. 
However, using an algorithm based on the thermally-activated pairwise exchanges of neighboring 
list elements, we find sorting can display many features of a glass, even for lists as small as N = 5. 
This includes memory and rejuvenation effects during aging — two hallmarks of glassy dynamics 
that have been difficult to reproduce in standard glass simulations. 

PACS numbers: 75.10.Nr, 64.70. Q- 



The slow dynamics of some low-temperature, out-of- 
equilibrium systems can be highly complex. Without 
the time nor the ability to sample all of phase space 
as the dynamics slows down, the relaxation develops a 
non-exponential form. The system is no longer station- 
ary, but will age, and it will often retain a memory of its 
previous thermal history. Structural glasses, formed by 
supercooling liquids, and spin glasses, formed by freezing 
dilute random spin systems, are quintessential examples 
with such behavior. Models with simplified dynamics, 
such as kinetically constrained models pQ , or those based 
on parking [2HJ, or relaxation on hypercubes [5 j, etc., 
have been proposed to illustrate one or another specific 
aspect of glassy relaxation. However, even such simpli- 
fied systems have strained the capacity of computers to 
reproduce many of the effects readily observed in the lab- 
oratory. Here we present a simple algorithmic model, 
based on sorting a small list of numbers, which displays 
many of the dynamical features associated with glasses, 
including those that have resisted replication by large- 
scale computer simulations. 

Consider the integers 1 ... iV, randomly arranged into 
a list S = {si, 52, . . . , 5 at}, to be sorted in ascending 
or descending order. We model sorting as an activated 
process governed by nearest-neighbor interactions, and 
define the following Hamiltonian, whose ground state is 
a sorted list: 
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Here Ho minimizes the difference between adjacent list 
elements, and is symmetric between S and its reverse. 
This symmetry is broken by the second term gM. Ap- 
plying g > (g < 0) selects the list sorted in ascending 
(descending) order as the unique ground state. Subtract- 
ing the constant s 2 — (N + l)/2 is so that a list and its 
reverse have values of M that are equal in magnitude 
but opposite in sign. For a sorted list, H = and 
M has maximum magnitude. The thermal-sorting al- 
gorithm ( "thermosort" ) is as follows: at each time step 
t, we randomly select two adjacent list elements and at- 



tempt to swap their places: S = {. . . , Sfc+i, ...}—> 
S' = {. . . , Sfc+i, Sfc, . . . }. The probability that this swap 
will be accepted is 



p(S S') = min|l,e" 



-(H[S'}-H[S])/T 



}• 



where T is an effective temperature. Thus S explores 
a space of TV! configurations via the thermally-activated 
swapping of adjacent list elements. 

Fig. [I] illustrates several aspects of glassy dynamics 
shown by this algorithm for small, N = 8, lists. Fig. 
[TJa) plots the relaxation of the ensemble- averaged en- 
ergy (H), starting from random initial states with g = 0. 
As T decreases, thermosort takes ever longer to reach 
thermal equilibrium. For sufficiently low T, (H) relaxes 
logarithmically over long stretches of time, indicative of 
a broad spectrum of relaxation times. The system re- 
mains far from thermal equilibrium even after millions of 
time steps. This is reminiscent of the slow, low-T, relax- 
ation (or aging) of structural and spin glasses, as well as 
the logarithmic compaction of a gently-tapped granular 
packing [6-9 . It is intriguing to find similar relaxation 
in lists of only 8 numbers. 

We define a susceptibility \m — 5M/5g, which de- 
scribes the linear response of M to a small applied field 
g. Figs. [IJb, c) plot the T-dependence of the complex 
susceptibility xm = (Xm?Xm)> measured for N = 8 by 
applying a small oscillatory field 5g at frequency /. Both 
x' M (T), XmOO are singly-peaked functions that shift to 
lower T and are taller and more sharply defined for lower 
frequency. Figs, [ljd-e) plot the frequency spectrum of 
Xm at thermal equilibrium for different temperatures. 
As T is lowered, the peak frequency f v of x'mU) shifts 
to lower /, indicative of a growing characteristic relax- 
ation time r p = l// p . Inset of Fig. [ljd) shows that r p 
appears to follow an Arrhenius law: r p ~ e 1 ^ . Again, 
the phenomenology here is very similar to that found in 
the magnetic and dielectric spectroscopies of spin glasses 
and glass- forming liquids [T0HT5] . 

At low T, the relaxation time of a glassy system is 
longer than the experimental timescale, and the glass is 
out of equilibrium. The properties of a glass are thus 
not stationary but depend on the experimental timescale 
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FIG. 1: (color online) (a) Relaxation of the average energy 
(H), starting from random configurations, at various T. (b, c) 
The complex susceptibility xm versus T, measured by ramp- 
ing from T — 50 to T — and back in steps of AT = 1, and 
dwell time/step ra w = 10 4 . Dashed line in (b) indicates the 
equilibrium xm in the DC limit, (d, e) The equilibrium spec- 
trum of xm at different T. Lines are Havriliak-Negami fits 
[12]. Inset of (e) plots the inverse peak frequency l// p = r p 
of Xm(/) versus 1/T. Data shown are ensemble- averages over 
10 3 independent realizations for N = 8 and g = 0. 



(aging), and on the thermal history (memory). A par- 
ticularly striking manifestation of these features is found 
in the "rejuvenation and memory" phenomenon, first ob- 
served experimentally in the magnetic susceptibilities of 
spin glasses, and subsequently in the dielectric suscep- 
tibility of organic glass-formers [T6HT9] . If, on cooling 
a glass from a high-T equilibrium state, the cooling is 
halted at T = T age and kept there for a period r age , then 
as the glass ages, the (magnetic or dielectric) susceptibil- 
ity, x" slowly decreases in magnitude. When cooling is 
resumed, after some time, the system appears to forget 
the aging experience and x"(T) reverts to the reference 
behavior it would have exhibited had the cooling been 
uninterrupted: the system is said to be "rejuvenated". 
If the glass is subsequently reheated, x"(T) initially fol- 
lows the reference curve. However, as T approaches T age , 
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FIG. 2: (color online) Aging, rejuvenation, and memory in 
thermosort, measuring x'm(T) at / = 4 x 10 3 versus T. Here 
T is ramped in steps of AT/rd w = 1/10 3 . (a) Dotted curve: 
reference XmOO without aging. Solid curve: cooling was in- 
terrupted at T age = 150 for a duration r ag e = 4 x 10 4 , allowing 
Xm(T) to age, forming a dip. Warming back up, the aged 
Xm(T) systematically dips below the reference in the vicin- 
ity of Tage- (b) The difference between the aged and refer- 
ence Xm (T) , obtained for two different values of T age (dotted 
line: cooling; solid line: warming). Data shown are ensemble- 
averaged over 10 5 realizations for N = 30 and g = 0. 



x" (T) will mirror the aging-induced dip — it remembers 
its cooling history. While seen in many experiments and 
subjected to several theoretical models, this phenomenon 
has proven difficult, if not impossible, to observe un- 
ambiguously even in sophisticated spin-glass simulations 

[Mil]. 

Fig. [2] shows thermosort can clearly reproduce mem- 
ory and rejuvenation, using only N = 30. Fig. [2|a) 
shows XmCO (averaged over many realizations) both in 
the reference behavior, when cooling is continuous, and 
when cooling was interrupted at T age and the system is 
allowed to age. In order to see the results more clearly, 
Fig. [2^b) plots the difference between the aged and refer- 
ence XmCO curves f° r two different values of T age . The 
aging dip stands out clearly, and at low temperatures 
there is rejuvenation as the aging curve reverts to the ref- 
erence one. On reheating, the memory dip is recovered, 
and it is clear that the memory dip tracks T age . Other less 
complex glassy effects, such as memory /annealing after 
step- wise shifts in T, the Kovacs effect, thermoremanent 
magnetization, and irreversible/reversible dynamics (as 
found in granular compaction [28]), etc., can be easily 
observed using N as small as 5 [29] . 

While Figs. [I] and [2] describe the average behavior of 
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FIG. 3: (color online) (a) The N = 8 configuration space 
projected onto the (M,Hq) plane for g = 0; filled circles 
mark locally-stable states, (b-d) Thermosort trajectories in 
the projected view, sampled at various T. Each color is an 
independent trajectory, 10 4 in duration, starting from a ran- 
dom configuration, (e, f) Quantifying trajectory localization: 
the localization extent in Ho and and M versus the obser- 
vational timescale r bs- Here, (AHo(r b s )) and (AM(r bs)) 
are ensemble-averaged over 100 independent trajectories, 10 5 
in duration; they are then normalized by their equilibrium 
Tbbs —> oo values. 



a large ensemble of independent thermosort realizations, 
we can also visualize individual "trajectories". We do 
so by projecting the space of N\ list configurations onto 
the (M, Ho) plane [Fig. j3^a)]. While this projection is 
not unique in that multiple configurations may have the 
same coordinate, the results are quite illuminating. At 
high T, a trajectory quickly covers the accessible config- 
uration space, as shown in Figure gb). But as T is re- 
duced, the trajectories become confined over long periods 
of time to one of a few large basins with only occasional 
transitions between them, as shown in Fig. [3^c). As T 
is reduced further, the trajectories become localized in 
smaller, more numerous, basins as shown in Fig. (3^d). 
Thus as T is reduced, the accessible configuration space 



breaks up into a succession of ever smaller and ever more 
numerous basins. 

To quantify the extent of localization, we divide trajec- 
tories into blocks of length r bs- Within each block, we 
calculate the standard deviations of Ho and M sampled 
by the trajectory. These standard deviations, AHq and 
AM, are then averaged over all time blocks, and over an 
ensemble of randomly initiated trajectories. The results 
(AiJo(7obs))> (AM(r bs)) describe the localization extent 
in Ho and in M as functions of the observation time r bs- 
While both quantities grow with T bs7 

Figs. [3](e, f) show 

that at low temperatures, (AHq) grows much faster than 
(AM). This suggests that M is the principal "coordi- 
nate" along which ergodicity is broken at low T. 

To understand why trajectories localize in basins at 
low T, Fig.Qa) visualizes the evolving configurations of a 
randomly initialized N = 8 list as it is cooled from T = 50 
to T = 0. The final T = state, S = {5, 3, 1, 2, 4, 6, 7, 8} 
is not fully-sorted, but consists of two sorted "domains" 
{5,3,1} and {1,2,4,6,7,8}, joined by a "domain wall" 
at 83 = 1. This configuration is locally-stable: swapping 
any adjacent pair leads to higher energy. All locally- 
stable lists have this partially-sorted domain structure; 
for large A/", locally-stable configurations can have many 
domains, so long as each domain contains at least three 
elements. From a complete enumeration of all lists up to 
N = 9, we find that above N = 5 the number of locally- 
stable configurations appears to grow exponentially with 
N as shown in Fig. [4^b), and that the average energy 
barrier to escape from locally-stable configurations grows 
at least as rapidly as N. These barriers stabilize the 
domains over long periods of time, allowing even small 
lists to exhibit glassy signatures. The smallest list in 
which domains are stable, N = 5, is also the smallest N 
to exhibit glassy dynamics. 

While inside a domain the list is ordered, the numbers 
are not necessarily in consecutive order. Therefore in 
order to anneal away a domain, rearrangements must oc- 
cur throughout and not just at its boundary. Thus even 
a partially-sorted list with large domains and low energy 
is configurationally far away from the two fully sorted 
ground states. This conflict between local and global 
ordering may be generic in glassy relaxation. For exam- 
ple, it is reminiscent of the proposal that glass formation 
in simple liquids arises from the incompatibility of local 
icosahedral order with long-range periodic packing [30]. It 
also suggests that the glassy dynamics of thermosort may 
be eased by incorporating "non-local" swaps into its ki- 
netics to destabilize locally- sorted domains. We define an 
interaction range r, such that Sk and sw can be swapped 
if \k — k'\ < r. Setting r = N — 1 removes all the locally- 
stable configurations except the ground states; this allows 
the system to quickly reach thermal equilibrium even at 
T = 0. Varying r does not change the equilibrium prop- 
erties of thermosort; but it does speed up the kinetics 
by increasing the connectivity of the configuration space. 
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FIG. 4: (color online) (a) The trajectory of a randomly initiated N = 8 list (dark — > light = 1 — »• 8), slowly cooled from T = 50 
to T = with g = 0. The end state at T = is a locally-stable configuration, consisting of two sorted domains concatenated 
at a "domain wall" (k = 3, arrow), (b) The number of locally-stable states versus iV, obtained by enumeration up to N = 9. 



This is reminiscent of kinetically constrained glassy mod- 
els, whose Hamiltonians are often trivial, but can exhibit 
glassy dynamics when their kinetics are sufficiently con- 
strained pp. 

As a sorting algorithm, thermosort is exceedingly poor; 
but it turns out to be an excellent glass-former. It ex- 
hibits a broad array of glassy phenomena, including re- 
juvenation and memory, which have proven difficult to 
reproduce in standard simulations of supercooled liquids 
or spin glasses. Since thermosort is such a simple model, 
yet capable of exhibiting glassy dynamics with as few as 
N = 5 list elements, we suspect it probably contains little 
more than the minimal makings of a glassy system. 

We thank Susan Coppersmith, Florent Krzakala, Erika 
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